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Abstract — In  this  paper,  we  discuss  the  threshold  based  stochas¬ 
tic  resonance  behavior  of  binary  input,  binary  output  discrete 
memoryless  channels.  We  follow  the  basic  model  of  Chapeau- 
Biondeau  where  he  showed  how  the  addition  of  external  Gaussian 
noise  could  enhance  channel  capacity,  thus  providing  an  optimum 
channel  capacity  depending  on  both  the  threshold  level  and  noise 
power  of  the  system.  In  order  to  easily  approximate  channel 
capacity  behavior,  we  use  capacity  bounds  and  approximations. 

Keywords — Bioinformatics  and  Biocomputing,  Systems  Secu¬ 
rity  and  Trust,  Computer  and  Network  Security,  Medical  Appli¬ 
cations  and  e-healthcare. 

I.  Introduction 

The  communication  channels  under  study  in  this  paper  are 
binary  input,  binary  output  discrete  memoryless  channels  [22], 
[24],  [14],  [15],  denoted  as  (2,2)  channels.  That  is,  the  channel 
is  discrete,  memoryless,  the  input  random  variable  X  has  (non¬ 
trivial)  values  {/ 1 ,  £2},  and  the  output  random  variable  Y  has 
(non-trivial)  values  {01, 02}.  Where  (overloading  notation),  the 
event  X  =  tk  is  the  event  that  the  symbol  tk  is  input  to  the 
channel,  and  the  event  Y  =  Ok  is  the  event  that  the  channel 
output  is  the  symbol  Ok- 

We  use  the  (2, 2)  channel  to  study  the  phenomenon  of 
stochastic  resonance  that  arises  from  modeling  the  discrete 
time  threshold  neuron  model  [7].  A  introduction  to  this  is 
given  in  [9,  Sec.  2].  We  closely  follow  the  mathematics  of 
[3]  in  this  paper. 

For  our  purposes,  stochastic  resonance  is  described  as  a 
counterintuitive  phenomenon  in  the  presence  of  additive  Gaus¬ 
sian  noise.  That  is,  under  the  proper  conditions,  for  both  small 
and  large  additive  noise,  associated  performance  metrics  (e.g., 
SNR,  mutual  information,  Fisher  information,  correlation,  dis¬ 
crimination  index)  are  small.  However,  for  some  intermediate 
noise  levels,  performance  actually  improves! 

We  focus  on  maximizing  the  mutual  information,  and  find¬ 
ing  the  capacity,  of  (2,2)  channels  in  threshold  communication 
systems  [1],  [3].  We  discuss  that  in  these  (2,2)  channels  there 
is  a  maximum  of  performance  measured  in  terms  of  channel 
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capacity.  This  maximum  of  channel  capacity  occurs  at  an 
optimal  value  of  the  added  Gaussian  noise  correlated  with  the 
threshold  level. 

Our  major  contribution  is  to  show  how  certain  approxima¬ 
tions  to  the  closed  form  of  channel  capacity  reflect  physical 
intuition.  This  is  of  interest  because  even  in  the  simple  case  of 
the  (2,  2)  channel,  the  non-linearity  of  the  capacity  expression 
makes  closed  from  analysis  intractable. 

We  also  briefly  show  how  to  view  stochastic  resonance 
results  in  terms  of  the  new  area  of  algebraic  information  theory 
[14],  [15],  and  provide  geometric  motivation  for  the  closed 
form  results.  In  particular,  we  show  the  significance  of  the 
determinant  of  the  channel  matrix  in  terms  of  the  capacity 
approximations  and  bounds. 

Note  that  an  immediate  application  of  the  ideas  in  this 
paper  is  the  counterintuitive  paradigm  that  adding  jamming 
noise  [21]  might  actually  increase  communication  throughput. 
Rather,  if  the  jamming  is  not  done  correctly,  then  we  might  be 
strengthening  the  communication  we  are  attempting  to  jam. 

I -A.  The  (2,2)  Channel 

We  summarize  freely,  without  quotation  marks,  from  [16] 
in  this  subsection.  Since  all  symbols  take  the  same  time  to  go 
through  the  channel,  all  information  theoretic  measurements 
are  in  units  of  bits  per  channel  usage  (symbol).  Furthermore, 
unless  noted  otherwise,  all  logarithmic  quantities  are  base  two 
logarithms. 

The  channel  matrix  represents  the  conditional  probability 
relationships  between  the  input  and  output  symbols.  That 
is,  a  =  P(oi|n),l  -  a  =  P(o2\ii),c  =  P(oi|t2),  and 
1  —  c  =  7^(02 1 1-2 )  •  The  input  probabilities  are  represented  by 
the  random  variable  X,  P(X  =  n)  =  Xi,i  =  1,  2,  which  we 
simplify  to  P(i\)  =  X\  and  P(t 2)  =  x2.  Similarly,  we  have 
the  random  variable  Y  such  that  -P(oi)  =  yi  and  P(o2)  =  y2. 
This  is  illustrated  in  Figure  1. 


Fig.  1.  (2,  2)  Channel  matrix  and  transition  diagram.  Note  that  det  M  =  a  —  c. 
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We  summarize  the  probabilities  as  follows 


Capacty  vs.(a,c) 


y  =  x- 


Where  a  =  1  —  a,  and  c  =  1  —  c.  Letting  x  =  x\  and  using 
the  fact  that  x\  +  X2  =  1  =  y\  +  y2,  we  have  that  y\  = 
(a  —  c)x  +  c  and  y^  =  1  —  y\.  To  calculate  the  capacity  we 
want  to  maximize  the  mutual  information  I  (A",  Y) 

I  =  H(Y)  -  H(Y\X ) 

over  all  possible  distributions  of  (aq,  X2)  =  (x,  1  —  x). 

Since,  with  a  and  c  fixed,  we  can  view  /  as  a  function  of  one 
variable  x,  the  maximization  problem  reduces  to  maximizing 
the  function  I  :  [0, 1]  — >  M  given  by 

I(x )  =  h(/(x))  —  xh(a )  —  (1  —  x)h(c ) 
where  h  :  [0, 1]  — 5-  R  is  the  binary  entropy  function1 


h(x)  ==  —  a;  log  a;  —  (1  —  x)  log  (1  —  x)  (1) 


and  /  :  [0, 1]  -+  [0, 1]  C  R  is  /( x)  =  (a  —  c)x  +  c.  Of  course, 
we  can  also  let  a  and  c  vary  and  view  I(x)  as  a  function  of 
three  variables  Ix(a,c).  For  fixed  a  and  c,  C  =  C(a,c)  = 
ma xxI(x)  =  ma xx  Ix(a,c),  where  C  is  the  capacity  [22]  as 
a  continuous  [19,  Sec  2.4],  [14],  [15]  function  of  a  and  c. 


It  can  be  shown  (see  Silverman  [24,  Eq.  5],  Ash  [2,  Eq. 
3.3.5],  or  [13],  [14])  that  capacity  C  :  I2  — »  [0,1],  where 
I2  =  [0, 1]  x  [0, 1],  as  a  function  of  a  and  c  is 


C(a,  c) 


_  ah(c)  —  ch(a) 


log  (z 


ah(c)-ch(a ) 


log  ( 


+  2 


Ma)-h(c)  ' 

1  +  2  -i-c 

h(a)-a. h(c)  \  ' 


(2) 


where  C (a,  a)  :=  0.  One  also  has  the  symmetries 


C(a,  c)  =  C(c,  a)  =  C{  1  —  a,  1  —  c)  =  C(  1  —  c,  1  —  a)  .  (3) 


C{a ,  c)  is  defined  and  continuous  for  all  (a,  c)  £  [0, 1]  x  [0, 1], 
is  zero  for  the  values  (a,  a),  and  is  1  if  and  only  if  (o,  c)  = 
(1,0),  or  (a,c)  =  (0, 1),  see  Figure  2. 

We  let  xo  denote  the  value  of  x  that  maximizes  mutual 
information  for  a  given  (a,c),  and  define  /3(a,c)  by 


/3(a,c)  = 


he(a)  -  he{c) 


a  —  c 


(4) 


where  he{x)  :=  —  xlnx  —  (1  —  x)  In  (1  —  x)  =  ln(2)  •  h{x). 
The  expression2  for  £0  is  given  in  [2],  [24]  as: 

£0  =  — * —  (  ,  1  B  ~  c )  ,  0<a,c<l,a^c.  (5) 

a  —  c  \  1  +  ep  J 

Note  that  xq  cannot  be  continuously  extended  to  the  closed 
unit  square  [0, 1]  x  [0, 1].  This  is  due  to  the  fact  that  (as  first 
noted  by  Silverman  [24],  see  also  [6],  and  proved  rigorously 


'Note,  “log”  is  base  two.  whereas  as  “In”  is  the  natural  logarithm.  The 
binary  entropy  function  is  defined  for  x  £  [0, 1],  with  h{ 0)  =  h(  1)  :=  0. 

h(q)-h(c) 

2It  is  worth  noting  that  e^(a,c)  =  2  a~c 


Fig.  2.  Capacity  as  a  function  of  (a,  c). 


for  more  general  timing  channels  in  [13]) 

lim  xo(a,0)  =  1/e,  limc^0+  2:0 (0,  c)  =  1  —  1/e  (6) 
a-s-0+ 

lim  :ro(a,  1)  =  1  —  1/e,  lim,,^-  xo(l,c)  =  1/e  .  (7) 

a-+l- 

The  above  shows  that  we  cannot  extend  xo  to  be  a  continuous 
function  including  the  comer  points  (0,0)  and  (1,1).  Stated, 
without  proof,  in  [24]  is  the  Silverman  conjecture 

l/e<xo<l  —  1/e.  (8) 

This  was  not  proved  until  1989  by  Rumsey,  as  demonstrated 
in  the  dissertation  of  Majani  [11],  [12]  (See  also  [23]). 

I-B.  Stochastic  Resonance  in  a  (2,2)  Channel 

Now  we  discuss  how  adding  noise  can  counterintuitively 
increase  channel  capacity.  Note  that  one  must  be  careful  with 
the  definition  of  noise.  The  motivation  for  this  comes  from  the 
physical  world  [20]. 

In  terms  of  Shannon’s  information  theory,  a  (2,2)  channel 
is  noiseless  [2]  if  M  is  the  two  by  two  identity  matrix,  or 
its  flip  (rows  interchanged).  However,  we  are  now  faced  with 
the  dilemma  of  what  it  means  for  one  channel  to  be  more 
noisy  than  another?  Do  we  compare  the  capacities  of  the  two 
channels,  do  we  compare  the  terms  a  and  c,  or  do  we  devise 
some  metric  to  see  how  “far  away”  the  channel  matrix  is  from 
the  identity  matrix,  or  its  flip?  No  matter  what  definition  of 
noise  we  use,  it  seems  counterintuitive  for  noise  to  increase 
capacity.  We  feel  that  the  use  of  the  term  “noise”  in  stochastic 
resonance  applied  to  information  theory  is  a  misnomer  and  we 
would  be  better  served  with  the  term  “disturbance  noise,”  or 
simply  “disturbance,”  denoted  by  .  The  idea  of  disturbance 
agrees  with  the  communication  system  model  as  shown  in  [1, 
Fig.  3.1].  It  is  the  addition  of  91j)  that  can  increase  channel 
capacity. 

The  input  random  variable  X  represents  the  physical  trans¬ 
mission  of  a  signal  X.  In  our  situation  36  takes  on  two  distinct 
values,  level  0  or  level  1,  represented  in  terms  of  the  random 
variable  as  l\  or  respectively.  The  disturbance  is  added  to 
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the  transmission  signal  resulting  in  the  received  signal  93: 

93  =  X  +  93s  .  (9) 


That  is,  each  time  an  input  symbol  is  sent,  an  independent 
draw  from  93j>  is  added  to  it.  Thus,  the  disturbance  may 
increase/decrease,  or  leave  unchanged,  the  transmitted  signal 
level.  The  value  (level)  of  91  can  be  any  real  number.  However, 
as  in  [3],  the  concept  of  a  threshold  is  developed  based  on  the 
physical  model.  The  threshold  interprets  91,  resulting  in  an 
output  random  variable  Y  in  a  discrete  Shannon  channel.  We 
do  not  analyze  the  physical  reality  of  such  output  thresholding 
[10],  [3];  rather  we  concentrate  on  the  information  theoretic 
analysis  of  such  a  scenario  (information  theoretical  analysis 
of  spike  trains/action  potentials  is  a  rich  area  of  research,  e.g. 
[18]).  We  optimistically  and  humbly  suggest  that  a  judicious 
addition  of  noise  into  a  synapse  signal  might  assist  in  neuro¬ 
logical  disease  healing  (for  background  see  [4]). 

We  have  a  threshold3  9  such  that 


Y  = 


if  91  <6; 
if  91  >  6. 


(10) 


Following  [3],  we  let  91x>  being  a  zero  mean  (/x  =  0,cr  > 
0)  Gaussian  distribution,  with  probability  density  function 
fa(t)  =  exp(^-),  and  cumulative  distribution  function 

Fa(x)  =  f*  fa(t)dt.  We  denote  the  cumulative  distribution 
function  of  the  standard  normal  distribution  (p  =  0.  tr  =  1) 

as  i  rx  -t2 

=  —i=  /  eT dt .  (11) 

V^rJ-oo 


Change  of  variables  shows  that  Fa(x)  =  §(x/cr).  Therefore, 
we  easily  have  [3]  that  the  channel  matrix  is  of  the  form4 


M  = 


1  —  a 
1  —  c 


(  Fa{9)  1  -Fa{6)  \ 

\Fa(0-  1)  1-F„(6-1)J 


{  Fa(9)  Fa(9)  \ 

W«-1)  Fa(e- i)J' 


and  the  channel  capacity  is  therefore 


C(Fa(9),Fa(9-  1))  = 


(12) 


(13) 


Intuitively,  raising  the  threshold  from  1  to  1  +  A  should, 
from  the  point  of  view  of  information  theory,  have  the  same 
effect  as  dropping  it  from  0  to  —A.  One  swaps  the  input 
symbols  and  also  the  output  symbols.  Some  more  thought 
shows  that  the  symmetry  is  actually  between  0  and  1;  that 
is  the  channel  capacity  should  be  symmetric  about  1/2.  We 
prove  this  (using  Eqs.  3  &  14)  mathematically  as  well;  that 
is,  we  will  show  that  Ca(.5  +  d)  =  CCT(. 5  —  d). 

Theorem  1.1:  Ca{. 5  +  d)  =  Ca(.5  —  d). 

Proof:  Ca(B)  =  C  (Fa(9),  Fa(9  -  1)) 
C(Fa(9-l),Fa(9))  =  C(l-Fa(l-9)1l-Fa(-9))  = 
C(Fa{l-9):Fa(-9))  =  Ca{  1  -  9 ),  so  Co- (.5  +  d)  = 
Ca  {1  -  (.5  +  d))  =  -  d)  m 

Nota  Bene:  Therefore,  without  loss  of  generality,  we  will 
always  assume  that  9  >  .5,  since  we  can  always  obtain  the 
values  for  9  <  .5  by  symmetry. 

In  [3]  the  stochastic  resonance  effect  was  demonstrated  for 
9  >  1,  and  no  stochastic  resonance  was  demonstrated  for  .8  < 
9  <  1.  This  was  done  via  discussion  and  plots.  Specifically, 
it  was  discussed  and  demonstrated  that  for  .8  <  9  <  1,  the 
capacity  monotonically  decreases  from  1  to  0,  as  a  function  of 
a  >  0.  This  is  because  if  the  threshold  9  <  1  then  we  have  a 
noiseless  and  useless  channel  if  there  is  no  added  disturbance. 
Note,  that  in  the  limit  as  a  — »  0+  that  91®  — >  S(t),  the  Dirac 
impulse  function  at  0.  We  note  that  [3]  did  not  discuss  the 
specifics  of  9  <  1,  the  lessons  learned  in  [3]  only  hold  if 
.5  <  9  <  1.  (See  also  the  “forbidden  interval”  theorem  [8, 
Sec.  6.2].) 

If  there  is  no  added  disturbance,  when  the  threshold  9  >  1, 
the  threshold  will  never  be  met  and  there  is  no  information 
flowing;  hence,  the  capacity  is  0.  However,  as  soon  as  there 
is  any  non-trivial  added  disturbance  (that  is  a  >  0),  there  will 
be  non-zero  mutual  information,  and  hence  non-zero  capacity. 
Graphically,  it  is  shown  in  [3],  that  the  capacity  starts  at  0 
for  a  =  0  and  then  increases  as  a  increases.  However,  when 
the  added  disturbance  grows  too  large,  the  capacity  starts  to 
decrease  again  and  approach  0.  This  makes  sense  because 
FJ9)  =  $(^),  and  FJ6  -  1)  =  -  ±).  So  for  large 

a,  Fa{9  -  1)%  Fa(9)~,  and  hence  C%  0.  ^ 


(  fg(fl)-h(Fg(B-l))-Fg(fl-l).h(F,T(8)) 

log  2  F„W-Wa{9- 1) 

Fg(e-l)-h(Fg(9))-Fg(8)-h(Fg(e-l))  \ 

+  2  FCT(«)-Fa(fl- 1  ) 

When  we  wish  to  emphasize  that  we  are  analyzing 
C{Fa{9),  Fa(9  —  1))  with  cr  fixed,  we  slightly  abuse  notation 
and  denote  the  capacity  as  Ca(9). 

Note  that  we  also  have  the  trivial  identity  of  zero  mean 
Gaussian  distributions 

Fa(-9)  =  1  -  Fa(9)  .  (14) 

3  Of  course,  we  could  simplify  the  exposition  by  using  values  centered  about 
0.  However,  we  have  used  the  present  formulation  to  mimic  [3]. 

4Where  x  =  1  —  x. 


Fig.  3.  Capacity,  for  6  6E  {.8,  .9,  .95,  .99,  1,  1.01,  1.05, 1.1,  1.2},  as  a  function  of  a. 
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We  reproduce  in  Figure  3  the  same  plots  that  are 
given  in  [3],  In  these  plots  a  G  (0,  .8]  and  9  G 
{.8,  .9,  .95,  .99,1,1.01,1.05,1.1,1.2}.  The  9  values  plot 
monotonically  from  the  top  (.8)  to  the  bottom  (1.2).  As 
discussed  above,  stochastic  resonance  is  not  exhibited  until 
9  >  1.  For  9  <  1  the  capacity  decreases  monotonically  from 
1,  and  for  9  >  1  the  capacity  increases  from  0  to  a  maximum 
value  and  then  decreases. 

Definition  1.2:  For  a  given  9,  a  a  value  that  locally  max¬ 
imizes  capacity  is  called  a  local  harmonic,  if  it  is  a  global 
maximum,  we  simply  call  it  the  harmonic,  and  denote  it  as 
ah. 

Judging  from  Figure  4,  and  our  discussions,  there  appear 
to  be  only  harmonics,  and  that  for  9  >  1.  But,  how  do  we 
prove  this?  The  obvious  tack  would  be,  for  fixed  9,  to  express 
capacity  as  a  function  of  cr,  written  as  Cg(<j),  and  then  to 
analyze  -fjfiCg(cr).  However,  that  does  not  seem  to  be  readily 
tractable,  as  can  be  seen  by  examining  the  closed  form  for 
capacity  as  given  in  Eqs.  (2,13).  Instead,  we  propose  using 
approximations  to  the  capacity  which  we  discuss  below. 

II.  Capacity  Bounds  and  Approximations 

So  far,  all  of  our  discussions  of  capacity  have  been  per¬ 
formed  by  using  the  closed  form  expressions  Eqs.  (2,13). 
However,  the  closed  form  for  capacity  is  very  difficult  to 
deal  with  because  of  its  non-linear  behavior.  Also,  the  closed 
form  does  not  generalize  (unless  the  channel  matrix  is  square 
and  invertible)  to  higher  dimensional  channels,  which  is  a 
topic  for  future  research  (see  also  [3]).  It  was  because  of 
the  mathematical  awkwardness  of  the  capacity  expression  that 
approximations  and  bounds  were  derived  in  [16],  [17]. 

A  (2,  n)  channel  is  a  discrete  memoryless  Shannon  commu¬ 
nication  channel  with  two  inputs  and  n  outputs.  Its  (stochas¬ 
tic)  channel  matrix  is  M  =  (  °'1  Cln~1  where 

y  Cl  ...  Cn—  i  C  J 

d  =  1  —  (or  +  ■  •  •  +  an_i)  and  c  =  1  —  (ci  -| - b  c„_i). 

We  use  the  following  approximations  to  capacity;  we  call 
the  lower  bound  the  Pinsker  bound,  and  the  upper  bound 
the  Helgert  bound.  These  bounds,  and  their  use  as  capacity 
approximations,  and  the  following  theorem,  are  discussed  in 
detail  in  [16],  [17], 

Theorem  2.1:  For  a  (2,  n)  channel,  the  capacity  has  Pinsker 
(lower)  bound  and  Helgert  (upper)  bound  as  given  below 


Y  K  -  5i|  >  +  |a- 


C 


n—  1  n—  1 


8  ln(2) 

<  max  (Y  ai>  Y bi)  -  Y  min(ai,  bi 

i=  1  i= 1  2=1 

For  a  (2,2)  channel  the  above  reduces  to: 

(a  -  6) 2 


2 ln(2) 


<C<\a-b\. 


(15) 


(16) 


We  note  that  the  determinant  of  the  channel  matrix  is  a  —  b 
[14],  and  a  —  b  is  also  an  eigenvalue  of  the  channel  matrix  [5]. 


III.  Approximation  Harmonics  for  the  (2, 2) 
Channel 


(a)  0  =  1.01 


Fig.  4.  Approximations  to  ah:  where  vertical  lines  intersect  top  and  bottom  plots. 
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1.5 


From  Eq.  (16),  and  the  fact  Fa(9)  >  Fa(9  —  1)  when  a  >  0 
(Note  that  Fa{9)  >  Fa(9  —  1)  for  a  >  0),  we  have 


(Fa(d)-Fa(6-  l))2 
2  ln(2) 


<  Ca(9)  <  Fa{9) 


Fa(0-  1)  • 


Note  that  these  bounds  share  the  symmetry  about  6  =  .5 
with  the  capacity.  This  is  because  FCT(.5  +  d)  —  Fa(. 5  + 
d  -  1)  =  Fa{. 5  +  d)  -  Fa{~. 5  +  d)  =  1  -  Fa{~. 5  - 
d)  -  (1  -  Fa{. 5  -  d))  =  Fct(.5  -  d)  -  FCT(— .5  -  d)  = 
Fa{. 5  —  d)  —  Fa(. 5  —  d  —  1).  Therefore,  we  can  continue 
with  our  blanket  statement  that  9  >  .5. 

In  Figure  4  we  plot  the  Pinsker  bound  in  red,  the  capacity 
in  blue,  and  the  Helgert  bound  in  green.  The  bounds  also  only 
exhibit  stochastic  resonance  for  9  >  1.  Since  the  bounds  are 
much  more  tractable  than  the  closed  form  for  capacity,  we 
instead  find  the  harmonics  of  the  bounds. 

From  above  we  have  that  the  (lower)  Pinsker  bound  is 

(Fa(9)-Fa(9-  l))2 

*  2 ln(2) 


and  the  (upper)  Helgert  bound  is  £>  =  Fa(9)  —  Fa (9  —  1)  .  We 
are  interested  in  the  above  critical  points  of  the  bounds. 

So  we  now  consider  and  (we  take  9  as  fixed  and 
view  the  bounds  as  only  functions  of  a  >  0).  The  critical 
points  of  coincide  with  the  critical  points  of  so  we 
only  concern  ourselves  with  the  later. 


Setting  this  equal  to  zero  we  arrive  at 


9 

9  -  1 


=  e 


(17) 


We  restrict  9  such  that  9  >  1,  and  are  use  a  >  0 


a  = 


(18) 


Fig.  5.  Optimal  noise  power  approximation  ah  as  a  function  of  8. 


IV.  Conclusion  and  Future  Work 

We  have  given  physical  motivation  for  our  information 
theoretic  analysis.  We  have  discussed  closed  form  solutions 
in  terms  of  channel  matrix  elements  and  have  shown  how 
capacity  bounds  can  readily  show  how  matrix  terms  affect 
capacity.  An  immediate  lesson  learned  from  this  paper  is  that 
adding  noise  with  a  fixed  mean  may  be  counter-productive  if 
one  wishes  to  negate  transmission,  and  we  should  rather  add 
noise  with  various  means  or  other  differences  in  moments. 
This  will  be  a  topic  for  future  research  along  with  a  further 
analysis  via  algebraic  information  theory.  In  addition,  in  future 
work,  we  will  use  simulations  to  see  how  capacity  might 
actually  be  achieved  in  both  the  theoretical  maximums  and 
out  approximate  maximums 

We  also  wish  to  keep  in  mind  how  stochastic  resonance 
may  affect  jamming,  and  to  consider,  from  how  the  ideas 
from  stochastic  resonance,  may  be  used  to  improve  signal 
transmission  in  defective  neural  synapses.  In  addition  in  future 
work,  we  will  use  simulations  to  investigate  jamming  and 
to  see  how  capacity  might  actually  be  achieved  in  both  the 
theoretical  maximums  and  our  approximate  maximums. 
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This  is  an  approximation,  which  we  denote  as  ah  for  a  given 
9,  to  the  optimal  noise  power. 

We  see  in  Figure  5,  the  limiting  behavior  of  oh.  This 
limiting  behavior  is  trivial  to  show  from  the  above  equation, 
but  we  wish  to  note  that  it  coincides  with  our  physical 
intuition. 
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